Papers with fine-grained entity typing
Hierarchical Losses and New Resources for Fine-grained Entity Typing and Linking (P18-1)
Copied to clipboard
| Challenge: | Existing methods to incorporate hierarchical information into knowledge bases have yielded little benefit. |
| Approach: | They propose methods to integrate hierarchical information using real bilinear mappings . they also propose two new datasets containing wide and deep hierarchies . |
| Outcome: | The proposed methods improve on flat predictions and fine-grained entity typing on FIGER dataset. |
LOME: Large Ontology Multilingual Extraction (2021.eacl-demos)
Copied to clipboard
Patrick Xia, Guanghui Qin, Siddharth Vashishtha, Yunmo Chen, Tongfei Chen, Chandler May, Craig Harman, Kyle Rawlins, Aaron Steven White, Benjamin Van Durme
| Challenge: | LOME is a system for performing multilingual information extraction with large ontologies. |
| Approach: | They propose a system for multilingual information extraction with a framenet parser . LOME is available as a Docker container on Docker Hub and a lightweight version is available on the web . |
| Outcome: | The proposed system outperforms or is competitive with the (monolingual) state-of-the-art . it can be used to build knowledge graphs with large ontologies and across multiple languages . |
ReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linking (2022.naacl-industry)
Copied to clipboard
| Challenge: | Entity linking is the task of recognising mentions of entities in unstructured text documents and linking them to the corresponding entities in a Knowledge Base (KB) the largest public EL dataset is Wikipedia, which covers just 3% of the entities in Wikidata. |
| Approach: | They propose a model which performs mention detection, fine-grained entity typing, and entity disambiguation for all mentions within a document in a single forward pass. |
| Outcome: | The proposed model outperforms state-of-the-art methods on standard datasets by an average of 3.7 F1 and can generalise to large-scale knowledge bases such as Wikidata and zero-shot entity linking. |
A Fully Hyperbolic Neural Model for Hierarchical Multi-Class Classification (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for fine-grained entity typing have a hierarchical structure . prior work has integrated only explicit hierarchic information by formulating a hierarchy-aware loss or by representing instances and labels in a joint Euclidean embedding space. |
| Approach: | They propose a fully hyperbolic model for multi-class multi-label classification that performs all operations in hyperbolical space. |
| Outcome: | The proposed model performs all operations in hyperbolic space on two challenging datasets and shows it is comparable to state-of-the-art methods on fine-grained classification with remarkable reduction of parameter size. |
A Systematic Study of Leveraging Subword Information for Learning Word Representations (N19-1)
Copied to clipboard
| Challenge: | Existing word representation models for morphologically rich languages use subword-level information, but their systematic comparative analysis across typologically diverse languages and tasks is still missing. |
| Approach: | They propose a framework for learning subword-informed word representations that allows for easy experimentation with different segmentation and composition components. |
| Outcome: | The proposed framework allows for easy experimentation with different segmentation and composition components, as well as advanced techniques based on position embeddings and self-attention. |
EnCore: Fine-Grained Entity Typing by Pre-Training Entity Encoders on Coreference Chains (2024.eacl-long)
Copied to clipboard
| Challenge: | Entity typing is the task of assigning semantic types to entities mentioned in text. |
| Approach: | They propose to pre-train an entity encoder such that embeddings of coreferring entities are more similar to each other. |
| Outcome: | The proposed method improves state-of-the-art on fine-grained entity typing and entity extraction. |
From Ultra-Fine to Fine: Fine-tuning Ultra-Fine Entity Typing Models to Fine-grained (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to fine-grained entity typing are limited by the errors in the annotation process. |
| Approach: | They propose a method that can be used to fine-tune a model to a new type schema without creating distantly labeled data. |
| Outcome: | The proposed approach outperforms state-of-the-art weak supervision based methods under the few-shot setting. |
Ultra-Fine Entity Typing with Weak Supervision from a Masked Language Model (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fine-grained entity typing use weak labels that are automatically generated. |
| Approach: | They propose to obtain training data by using a BERT Masked Language Model (MLM) given a mention in a sentence, they construct an input for the MLM so it predicts context dependent hypernyms of the mention, which can be used as type labels. |
| Outcome: | The proposed model improves performance by using type labels generated from a BERT Masked Language Model given a mention in a sentence. |
Aligning to Constraints for Data-Efficient Language Model Customization (2025.findings-naacl)
Copied to clipboard
Fei Wang, Chao Shang, Shuai Wang, Sarthak Jain, Qiang Ning, Bonan Min, Vittorio Castelli, Yassine Benajiba, Dan Roth
| Challenge: | General-purpose language models (LMs) are aligned to diverse user intents, but fall short when it comes to specific applications. |
| Approach: | They propose a framework that uses constraints to automatically produce supervision signals for user alignment with constraints. |
| Outcome: | The proposed framework can produce supervision signals for user alignment with constraints. |
Learning to Learn and Predict: A Meta-Learning Approach for Multi-Label Classification (D19-1)
Copied to clipboard
| Challenge: | Existing models for multi-label classification ignore complexity and dependencies among labels . Experimental results show that our method can obtain more accurate multi-lab classification results. |
| Approach: | They propose a meta-learning method to capture complex label dependencies . they use a Meta-learner to jointly learn the training policies and prediction policies for different labels. |
| Outcome: | The proposed method can capture complex label dependencies on fine-grained entity typing and text classification tasks. |
Prompt-learning for Fine-grained Entity Typing (2022.findings-emnlp)
Copied to clipboard
Ning Ding, Yulin Chen, Xu Han, Guangwei Xu, Xiaobin Wang, Pengjun Xie, Haitao Zheng, Zhiyuan Liu, Juanzi Li, Hong-Gee Kim
| Challenge: | Extensive experiments on fine-grained entity typing under fully supervised, few-shot, and zero-shot settings show the effectiveness of prompt-learning. |
| Approach: | They propose a prompt-learning pipeline that stimulates versatile knowledge of pre-trained language models (PLMs) by constructing entity-oriented verbalizers and templates and conducting masked language modeling. |
| Outcome: | The proposed approach can be applied to fine-grained entity typing in fully supervised, few-shot, and zero-shot scenarios. |
A Chinese Corpus for Fine-grained Entity Typing (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing datasets for fine-grained entity typing are limited to English . a corpus of 4,800 mentions is manually labeled with free-form entity types . |
| Approach: | They propose a Chinese fine-grained entity typing task that uses crowdsourcing . they categorize each mention into 10 general types and use a large tag set to predict open set of types . |
| Outcome: | The proposed dataset contains 4,800 mentions manually labeled in Chinese . it also categorizes all the fine-grained types into 10 general types . |
An Attentive Fine-Grained Entity Typing Model with Latent Type Representation (D19-1)
Copied to clipboard
| Challenge: | Existing fine-grained entity typing models are criticized for label independence assumption . |
| Approach: | They propose a fine-grained entity typing model with a new attention mechanism and a hybrid type classifier to exploit type inter-dependency with latent type representation. |
| Outcome: | The proposed model significantly advances the state-of-the-art on fine-grained entity typing. |